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ABSTRACT 



ESDP is a proposed system whoso ourposr; 
store, retrieve, publish and diss em in ate all 
exclusive of graphics, concerned with a 
proqramminq activity. Do cum en tat ion is deomf^d 
onl V of final or formally publishel 3ftrr-the-fac 
of working files, design and change notices, 
manaaement reoorts--in fact, the entire re cor 
underlying a programming system. fiaxiTium at 
concentrated on the means of ace u icing 
documentation. Two major, complementary approach 
Th<^ first i^ called Program Analysis and i 
§il£3.2tiI13 documentation directly from comnleted 
second is called Computer Assisted Interrogation 
of el iciting information directly from the pro 
on- line coirimunication terminals. The former pro 
dat a about the prog ram • s st ruct ure. The 
explanatory miterial about all aspects o^ the pro 
absence of canonical data, may provide tpnta 
inform a tion is well. The conclusion of the stu 
ESDT^ is a feasible concept with present-day techn 
it will materially benefit using organizations i 
of programs and in guiding i"heir evolution 
c>i an ac. Its value will be greater for large 
whoso interna 1 communications di f fie ul ties tpnd 
gigantic inefficiencies. Its implemontation as 
for such projects would reguire a significa 
investment in order to produce these benefits a 
on the use of a computer system dedicate 1 solely 
ESDP. 
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I 

THE CAINT EXECOTTVE LANGUAGE 



!• Introduction, In this volume we describe the conversational 
programming language, called the CAINT Executive Language or CEL, 
and describe its application to interrogation and instruction. 

The reason for developing CEL was to provide a facility 
for programmers that would enable them to write conversational 
programs easily. A conversational program in the context used 
here is a computer program which carries on a conversation 
bet ween man and machine for the purpose of exchanging 
information^ and for which there is a need for generality in 
expressing the conversational elements. Generally^ in 
conversational programming systems^ interaction is between a 
programmer or designer one hand and an operating system on the 
other, and conversations are limited to computer programming, 
graphic design, text editing, or whatever application has been 
built in at the operating system level. In computer assisted 
instruction, to which CAINT is similar, conversations cover a 
wider range of topics and there is an intermediary program, the 
course, written by someone other than the programmer of the 
operating system. The student taking a CAI course, for all 
practical purposes, is aware only of the course and the 
particular limitations and capabilities it has. He is not 
necessarily aware of the operating system. 

In CAINT, as in CAI, the student, or responder or 
documentor, deals not with the operating system but with a 
program, or "course, " written by an ex ecu t ive programmer. 
Conversational technigues are the result of the style of the 
executive programmer, not the basic system logic. 

Sections I and II of this volume are primarily devoted 
to a description of the language and to technigues for its use in 
interrogation. While its use in instruction imposes no 
additional requirements or constraints, we have devoted most of 
our effort on instruction to the generation of instruction 
programs. Sections III and IV describe our approach to 
instruction and the Instruction Generator, a CEL program that 
produces CAI or PI courses. 

2. Language ^£5LuiE§ni§nts. A conversatfional programming 
Ian guage, in this context, does nothing different from an 
ordina ry programming language. The difference is in emphasis and 
in the relative ease of writing certain kinds of program 
expressions or in accomplishing certain kinds of program steps. 
The CAINT Executive Language is a general language and could be 
used for almost any applicat ion, albeit inefficiently in most 
cases. Similarly, almost any other language could perform th e 
logical functions of interrogation or instruction but, we think, 
seldom with the ease and efficiency of this PL/I dialect. 



Let us consider briefly what the major conversational 
functions are and then review each in greater detail. The 
con versat ional programmer would like: 

a. To be able to decide what question the machine 
should ask of the man at any given point in the conversation and 
to be able to do this on the basis of any definable function of 
the program' s data base^ including^ but not limited to, the 
response to the last question. 

b. Not to have to store the exact text of every 
question before asking it. Hence, the program should be able to 
assemble a question either from fragments or skeleton questions 
or from the data base. 

c. To make actual presentation of the question 
through a suitable output device, elicitation of an answer, and 
storage of the answer as mechanically simple as possible because 
the se are such high frequency operations. 

d. To permit a wide range of response types such as: 
mult iple choice, a single number, full text. 

e. To have a simplified method for programming of 
response analysis. The author should be able to decompose an 
answer into an array of words, test a response against an array 
of possible values, or perform any of a large number of other 
text- ha nd ling functions with a minimum of programming effort. 

f. To have a simplified logic for coping with 
unrecognizable (unanticipated by the author) answers. This would 
permit the writing of extensive programs for keeping track of 
unrecogn izable answers and varying the content of machine 
init later] messages depending on the number of consecutive 
unrecognizable responses. 

g". To have a large number of functions on which 
branching decision can be made. Branching within the 
con versa tiona 1 program is, of course, a requirement. Branching 
decisions should be able to be made on the basis of any definable 
f unct ion of the data base. 



h. To have any portion of the conversational program 

able to be operated as a subroutine so that it may be executed in 

other than its normal sequence. This permits reviews and 
updating. 

i. To have the student be capable of controllina 
program execution, to some extent, by the use of non- responsive 
answers to quest ions, A n on -responsive answer is one which 
substitutes a command for the response called for. Such commands 
include: r.O TO, SIGN OFF, QUERY and BACK. The last of these 
enables a res ponder to reverse the sequence of operation of the 
program and step backward through the last n questions. It can 
be used to recover from the situation where the responder gives a 



legal but incorrect response^ then discovers that he did not mean 

to give that answer and now wishes to pursue the logical path 

which would have resulted had he given the correct answer the 
first time. 




In experimental work to date, we have used the IBM 2260 
cathode ray tube display terminal as the man-machine interface. 
Hard copy terminals, such as the IBM 1050, can be used by linking 
the PL/I programs with the Queued Telecommunications Access 
Method (QTAM) of OS. This linkage will have to be accomplished 
through an assembly language program. It has not been 
accomplished to date, but there are no theoretical problems 
anticipated in doing so. The desirability of having a hard copy 
terminal in addition to a CRT is, we think, established. In 
spi te of the obvious speed advantage of the CRT there is of tpn a 
need to review a previous question or answer. If all reviewing, 
however brief , requires a query instead of a glance up the page, 
the responder must lose his train of thought. 

a. The Question as a Unit of Programming 

Programs in CEL are written in units called questions. 
As the name implies, a question is all the coding concerned with 
elicit ing an item of information or a response to on< 
interrogation question. There may ^ ' - ^ - - 

coi 
on] 
e] 
The qi 




le 

le 
beginning of a question and at several Doints within one. The 
use of the latter is described below. 

b. Subroutines 

Let us consider a set of subroutines which perform some 
of the basic tasks in the use of CEL. There are six major ones, 
concerned with message transmission, response elicit at ion, 
branching and program bookkeeping. 

ASK assumes a message is stored in da ta item MSG. It 
displays the message on the terminal indica ted and elicits a 
response. The response is stored in item RES. The program 
author, then, deals only with MSG and RES and need not be 
concerned with the mechanics of message transmission or receipt. 



TELL causes the contents of MSG to be displayed, but 
elicits no response, 

TNTT is used in the heading of a question to initialize 
a number of parameters used in program bookkeeping, 

Nitixr is used in the ending of a question to perform 
bookkeeping functions and to branch to the next question to be 
used. At many points within the question the decision on what 
question to branch to next might be made, but rather than 
per forming the transfer, a variable is set to the address to 
which transfer is made later. Actual branching from one question 
to another is always done from NEXT. 

UNHECOG counts the number of successive unrecognizable 
responses, provides a message to the console after each and, if 
necessary, terminates the conversation. Provision is made for 
hav ing a M f fer ent machine statement follow each successive 
unrecognizable response, 

KBYnIXT extracts key words and/or punctuation from the 
text of a user's response. The punctuation option is often us^d , 
even when short answers are elicited, to remove the differences 
among, for example, yes, YES, and Yes, Keyword extraction is 
used for indexing responses for later retrieval, and for testing 
the validity of a text response in an instructional mode, 

A series of retrieval subroutines permits initial 
storage, replacement, retrieval or deletion of an item or a 
structure in the program data base on disk. 

c. An Example 

To write a guestion, the program author must have: a 
label, a CALL to subroutine INIT and a CALL to subroutine AS?', 
Pri or to ASK, he must have set t he character string designated by 
the label MSG equal to whatever message or guestion hp wishes to 
present, 

Response analysis consists largely of a series of IF 

statements, eich of which may have a THEN and an ELSE clause 

following. Figure 1 shows an example from an instruction 

executive program. In reading this condensation of a program, 

bear in m ind that a branch command would normally occur within 
each DO group. 



LABEL: CALL INIT; 

liSG = 'IN WHAT YEAR DID THE CIVIL WAR BEGIN?*; 
CALL ASK; 

IF RES = •1865' THEN DO; END; 

ELSE DO; .•. END; 

IF RES = '1861* THEN DO; END; 

CALL ONHECOG; 

Figure I» A Sample Interrogation Program 
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author anticipates responses of 1965 

by a respond er is unrecognizable. The 

have anticipated a larger number of 

sed ineguality matching and completely 

f an unrecognizable answer. Here, the 

commands to be executed if the answer 
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a grade, prepare for a transfer, or 



If the student' s answer is unrecognizable, the 
subroutine types out a message informing him of this. Some 
authors may choose, at this point, to review the mechanics of 
answering, assuming the cause of the error might have been a 
keying error. With the second unrecognizable answer, the author 
might give a hint, and with the third, he might warn that the 
responder will be cut off if another unrecognizable reply is 
given. 

Within the DO ... END group, any assignment statements 
or subroutine calls are permitted. The IF statements may be 
complex , allowing nested logical expressions such as IF(A = '2') 

& (B = *1«) j (C = »U') THEN PL/I allows for another IF in 

the DO ... END group, but CEL does not permit this. In PL/T 
not at ion F^ implies AND and means OR. 

d , Labels 

Labels on guest ions must be included in a label arrny. 
We use the form LL(n). The variable n has many uses within a 
proqram. For one, it becomes thp means of communicating transfer 
information- If, within an IF statement, it is decided that the 
next guestion to be asked is guestion LL (X) , a direct branch 
cannot be ruad^ at this point. This, it will be recalled, can 
only bo done from NEXT. Instead, an index, 3, is set to th^ 
value X and later, in NEXT, transfer is maie to LL (g) . Internal 
labels within a guestion are explained in the section on 
instruction . 
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ne function of INIT and NKXT is to maintain a list of 
executed. This list, which neei not contain more than 

last five guest ions executed, is used when the 
calls for BACK. Typically, he would do this if he 

had given the wrong answer to a guestion and wants 

to answer again. By responding BACK to the next 

kei of him, he backs up to the previous guestion. 

is asked, he can answer responsively or BACK again, 
s found the guestion he wants or has reached the end 
St. B AC King also reguires the removal of data b^se 
at were inserted as a result of the wrong (but leaal) 



answer. 

^* l§s2onse Processina* Almost anywhere within a program an 
author may enter processing statements. Usually, these will be 
restricted to use just before the response is elicited or in the 
DO groups following the string of IFs in response analysis. In a 
program produced through the Generator (Section III,2) there are 
more restrictions on placement. 

Processing can consist of any assignment statements or 
CALLS to subroutines. While a question is only intended to 
elicit one information element, the author may include 
instructions for several messages to be displayed to the 
responder within one question unit, giving him instructions, 
congratulating him (if a student) on a correct answer, and so on. 

Figure 2 shows a short example of a question to 
illustrate a typical response analysis. 



figure. 



The following comments are keyed to line numbers in the 



I. The question label is LL (1) . The first function 
is initialization. 

2 ,3 The first question is set up and asked. 

a. Function MEMBER (A,B) returns 'l' if A is a member 
of array B, 'O* otherwise. If the name is known 
to the roster: 

5. Set BRL (branch label) to 2 to indicate that the 
next question to be executed is LL (2) . 

6. Now branch, within the quest ion, to LE(1) (E for 
ending) . 

8. This begins an ELSE clause, used when the name is 
not on the roster. 

9 . This illustrates use of the data base in composing 
a message. The message being formed here inclu ies 
the name just entered, concatenated (H ) with the 
text shown. 

10. This message is displayed, but calls for no 
response. 

II. LL(99) is assumed to be a sign-off point. 

lU. The label LE (1) indicates the ending section of 
the question. 



1 LL (1) : CALL INIT; 

2 KSG - 'WHAT IS YOUR NAME?*; 

3 CALL ASK; 

a IF MEMBER (RES, ROSTER) THEN DO; 

5 BRL = 2; 

6 GO TO LE (1) ; 

7 END; 

8 ELSE DO; 

9 MSG = RES 11' IS NOT ON ROSTER, PLEASE CHECK 

WITH PROCTOR, ' ; 

10 CALL TELL; 

11 BRL = 99; 

1? GO TO LE(1) ; 

13 END; 

m LE (1) : CALL NEXT; 



Figure 2. Response Processing 



^* 5§view and 0£date. Whether in an instructional mode or an 
interrogation mode, there is a need to be able, at any given 
point , p, in a program, to execute selected questions and then 
return to p. In interrogation, we do this in order to change the 
con tents of a data base item. Recall that our method of updating 
(Volume 1, Section II. 5) requires that questions concerning the 
item to be changed be asked again and that a different path 
through a set of related questions might result from the change 
than was originally used. In instruction, at various points in a 
course the author may wish to compute a set of review questions 
based upon the individual student's performance. Again, given a 
set of questions to be reviewed, the execution path through these 
questions may be different than the original path through them. 

The reviewed portions may consist of a single sequence 
of questions, or it may be an unconnected set of questions. 
Presumably, the number of possible combinations is large or the 
author could have set up the subroutines himself. Instead, he 
programs criteria for selecting review questions as a function of 
performance. In interrogation the same technique is used for 
updating previously entered documentation. We have used the 
principle that programmers make changes to documentation by 
identifying the information element to be changed and then being 
reinterro gated about that element. 

Reinterr oqation or review might result in execution of 
a different sequence of questions than were originally executed. 
Hence, what the author specifies is not the actual sequence of 
review questions but the beg inning and end points of a set of 
questions. Questions are then executed in normal sequence until 
the specified end point is reached an 3 return is made to the 
sequence control point. Any number of such segments can he 
specified by an author to satisfy any one review or 
reinter rogation item. 

At the end of each question, then, a test must be made 
to see if the question was executed in sequential or review mode. 
If sequential, the next question executed is that indicated by 
the question' s branch logic which points to the next question to 
be asked. If in a review mode, a branch is made out to the 
sequence control routine which checks to see if this question 
marks the end of a review sequence. If this is so, control 
passes to the next review sequence or to the elicit at ion of a new 
updating or review command. If it is not the end of a sequence, 
control goes back to the NEXT subroutine and that routine 
branches to the question indicated by BRL, a variable which is 
set to the index value of the label to which it is desired to 
branch. 



^- §E§Si:§:]: Ii§§E2115§§- ^he responder ^t a terminal can alter thf^ 
sequenco of operation of an executive program and may interrupt 
its operation and resuTie later. Whenever his keyboard is 
unlocked the responder may give one of the responses listed below 
instead of the reply requested. In experimental work these 
responses have been prefaced with // so as not to be confused 
wit h valid replies, 

GO TO n causes the executive program to begin executing 
quest ion LL (n) and picking up future sequence commands from 
there, 

QUERY invokes an on-line retrieval system. The 
responder may then query the data base on an information element 
number (IKN) or a key word. An ISN is assigned to each element 
in the data base. If a key word search is elected , the program 
retrieves the list of lEM's in which the given word has occurred 
and then executes a series of TEN searches. Upon completion of 
the search, the executive program resumes with the question it 
tried to execute when interrupted, 

REPORT invokes a report generating program. As 

presently written, this program gives the responder the option of 

receiv ing a standard, pre- designed report or designing his own 

report by specif yi ng a set of lEN's, The report, in either case, 

is printed on the high speed printer and then the interrupted 
question is resumed, 

BACK causes t he executive proqra m to return control to 
the previous question executed, A short history of the last n 
questions is maintained to allow backing over several questions, 

CHAMGE indicates that the responder wants to stop 
working on the present UOP and switch to a different one — perhaps 
to describe a new one he has just named for the first time, 

SIGN OFF terminates the executive program. The 
responder is informed of the quest ion number at which he 
terminated and he may use this to resume in his next session. 



The following responses are under 
are usually user! as indicated. 



author control but 



NO signifies the responder does not wish to answer the 
question. This is interpreted as meaning that no answer is 
currently available or that the question does not apply. This 
response is often used in design interrogations when full details 
are not yet known, 

END is used to signify the end of a list when an array 
of responses has been elicited, A guestion is asked and the 
responder gi ^^3 3 one array element. After each element the 
keyboard is briefly locked as the reply is stored. When the 
keyboard is unlocked, the responder enters the next elenient or 
//END, 
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HELP in effect means "Give me a restatement of the 
question." When displaying to the relatively slow typewriter, 
program authors may use terse wording to avoid boring the 
res ponder. The responder, however, may then occasionally need 
amplification of the question. The author^ of course, must have 
anticipated this and provided more than one version of the 
question. This function has not been implemented yet. 

HINT might be used to ask for assistance in answering a 
question in an instruction program. 

7. PocUSSIlt incj CEL Programs. Interrogation and instruction 
programs require documentation, just as do other forms of 
computer programs. The structure of a CEL program is generally 
far simpler than a typical computer program. The major point of 
interest is what is said to the res ponder or terminal user and 
what answers are anticipated from him. Hence, a different, fully 
automatic form of documentation has been devised for these 
programs. 

Briefly, the documentation of an instruction course 
will consist of a list of questions, the anticipated answers and 
a summary of what is done if a given answer is received from the 
terminal. This listing is in order of question number. The 
listing is followed by a key word index of all text of machine 
utterances. 

Sample output of a preliminary version of this 
documentation is shown in Figure 3. 
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QUESTION NUMBER: 001 

THE BINARY NUMBER SYSTEM. 

THE BINARY NUMBER SYSTEM CONSISTS 
OF TWO DIGITS, A ZERO AND A ONE. 
THESE USUALLY REPRESENT THE OFF AND 
ON STATES OF A BI-STABLE ELEMENT. 
BY COMBINING THESE DIGITS IN STRING 
FOR^, NUMBERS OF INCREASING SIZE 
CAN BE REPRESENTED. 



SINCE ONLY TWO DIGITS ARE USED, 
ALL NUMBERS CAN BE REPRESENTED. 
TRUE OR FALSE? 



NOT 



ANSWER 
TRUE 
FALSE 



BRANCH 
001 
002 



TO 



QUESTION NUMBER: 002 

EACH PLACE IN A BINARY NUMBER 
REPRESENTS A POWER OF TWO, WITH 
THE RIGHT-MOST BEING TWO TO THE 
POWER ZERO. 



THE BINARY NUMBER 1010 IS THE 
REPRESENTATION OF A DECIMAL: 

A: ONE THOUSAND TEN 

R': FOUR 

C: TEN 

D: ONE HUNDRED ONE 

E: NONE OF THESE 



ANSWER 


BPANCU 


A 


002 


B 


002 


C 


003 


D 


002 


E 


001 



TO 



Figure .1. Example of CEL Proqram Documentation. 
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KEY WORD INDEX 



BINARY 


INS 


001 


INS 002 


BI-STA 


INS 


001 




COMBIN 


INS 


001 




DECIMA 


INS 


002 




DIGITS 


INS 


001 




EACH 


INS 


002 




ELEME 


INS 


001 




FALSE 


INS 


001 




FORM 


INS 


001 




HUNDRE 


INS 


002 




NONE 


INS 


002 




PLACE 


INS 


002 




POWER 


INS 


002 




SIZE 


INS 


001 




STATES 


INS 


001 




STRING 


INS 


001 




SYSTEM 


INS 


001 




TEN 


INS 


002 




THOUSA 


INS 


002 




TRUE 


INS 


001 




USUALL 


INS 


001 




ZERO 


INS 


001 


INS 002 


1010 


INS 


002 





Figure 3. Example of CEL Program Documentation (concluiod) 
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II 



TECHNIQUES OF IMTERROQATION 



1* Ill§ I^§.tS ltl]i2lllE2* From a programming point of view, thp 
object of an interrogation is to make entries in, or make changes 
to, a data structure. This structure may he an image of a 
report, the r^w material from which a report is made up, a 
computer file to be used only as input to another computer 
program, or, is we shall describe in Section III, a computer 
program, itself. The first step in creating an interrogation 
program is to design the data structure that the program will 
work with. 
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ationship. Each item of information 
icited or changed should have a 

of the inf orma tion retrieval system 
tal versions of CAINT requires that 
is of lEN's. Hence, any information 
e stored on, and retrieved f rom , 
in the TEN structure. 



We have pointed out that any information in the data 
base may be used within any question, to contribute to decision- 
makinq, to assemble the text of a question, or as part of 
response processing or student performance analysis. In iny 
given question, then, any number of information elements may be 
retrieved, hut only one should he stored. This information, such 
as various program switches , constants, etc. , may be defined via 
PL/I DECLARE Statements at the discretion of the programmer. 
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1 INPUT 

1.1 ARRAY OF 'INPUT NAMES AND SOURCES 

l.l.n NAME AND SOURCE OF INPUT N 
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1,1. n,l 



NAME OF INPUT N 



1,1. n,2 



SOURCE OF INPUT N 



In the intpcroqation program reference may be made to lEN 
l,1.3,2y which is the source of the third input. It should be 
apparent that a change in the file structure may induce a change 
in the interrogation program and vice versa. It should also be 
apparent why indiscriminate changos cannot he made in data base 
structure without consultation among all programmers of CEL 
programs using the affected data items, Mention was made of this 
restriction in Volume 2, Section II. 2, 

2- Interrogation Seg^uence, Having decided upon the data 
structure to be used , the CEL programmer must then consider what 
questions to ask^ under what conditions to ask them, and in what 
order to ask them. The first of these considerations is largely 
one of how to communicate with the responder and we shall discuss 
it in qr^at^^r detail in Section II. 1. 

Not all questions are used in every interroqation. As 
a simple example, if a programmer taking an interroqation has 
just replied that a particular data item is alphabetic, we do not 
ask him whether he will use fixed or floating point 
representation. Each response received should be used to the 
greatest possible extent to by-pass irrelevant questions and to 
make relevant ones more specific. 
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3. Con sj.de ring the Res£ondec, Writing an interrogation program 
is carrying on a conversation vicariously. Since it is the 
object of this conversation to acquire a specific, complex set of 
inf orma tion, the job is by no means trivial. The CEL proqramner 
must consider what the responder knows when he takes an 
interroqation , how fast he is probably able to work, how fast ho 
would like to work, and how easily he can be bored. Skill in CEL 
proqramming does not come automatically from skill at 
convent ional programming. It requires a mixture of conv^^ntioaal 
proqramming skill, skill in writing or speaking- -the 
com muni cat ion of ideas to people — and experience in both writinq 
and tak inq interroqations. 
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a. The Scope of the Question 



^or reasons having to do with 
progranis, we have suggested restricting a 
acquisition of a single information element, 
programmer must consider carefully how much information to 
into a single TEN and must consider the effect on the response r 
of askina either too much or too little at one time. 
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To assist the CEL programmer we h 
question modification technique and have co 
second one, not yet implemented. The first i 
programmed instruction concept of a fading cue, 
con text, means reducing the amount of explanatio 
successive use of a question. Recall that 
programs, the re sponder is going to see the sara 
questions over and over again, as he reports o 
and data items. The first time, or the first fe 
a question he needs an explanation of what it me 
the answers fit in the overall data base and 
few times, particularly when using a typewriter 
slow output rate, the responder needs only to be 
question is' being asked, not necessarily given t 
of the guestion. 
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At ore sent , we allow for three different versions of a 
question and shift from version one to two and then to three 
after a predetermined number of uses. After a programmer has 
answered the question, "What is the function of this UOP?" 
several times, he need only be asked , "Function" to know how to 
respond. Eventually, we would allow a responder to recall 
version one in case he forgets its meaning, by responding //HELP 
to the short form of the question. 

The spcond technique is to enable the CEL programmer to 
combine se vera 1 questions into one, in the manner of a fading 
cue , based upon repetition of the questions, A succession of 
questions might bo these : 
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First iteration: ^^IIAT I^ YOIJR NA^E? 

WHAT TS YOUr< RANK? 

WHAT IS yOlIP S^^IAL NIIIBEP? 

Socond iterat-ion: niv^ yOHR NAME, ?AMK, AVD 

SEL^TAL NH^iBEH SEPARATED 3Y / 

Thirl iterition: NA!^E/R ANK/SERT AL '^^O. 

In anv updating activity, a return to tbo separate questions i.s 
r^n uir*=^^l. 

b. loact ion '^im^^s 

■iuch is sail anci written on thp subject of rf^^|'»ons«-^ 
tinos in man-'nach in^ f^ysto^s, although littlo has be^n fimlv 
pstablishod. Wp have not *lonp any ^oma] ^xpprimpnta t ion in thiii 
area, but wo have ^lovelopofi some convict ions. Not surncisinaly, 
wo f ini that respon-lnrs react dif fer^ntl y to do lays at different 
points in a conversation. We may classi'^y these approxiniatoly as 
f ol lows: 

(^•) liilliill 3. 3ii25ii2Il» ^^ ^ function of both 
program mi nq and hardware, some systems imposp delays , or 
oth^^rwise encumber the resnonder, durinq th^ printing o^ i 
macliine utterancp or the entry of lata bv thp man. ^or exarrplp, 
the ] UUO CAT system with which we did our early experimentation 
imposed a fix^d, one-second delay at the '^nd of ^ny lin^^ of 
print , even if in thp mi Idle of a sentonc^. Ve found this to be 
disconcertina to th^ reader. Some V'^rsions o^ the sam*'^ syst'^m 
rpq uir e t he rpspondpr to leprpss a request ke y pach tim*^^ h -"^ 
wishes to make a response, th^n wait a variable Ipnath o'" tin^*, 
r^rpjv excooiinq about two spconls, for the keyboard to be 
unlocked. This is also bothersome b^^ciuse it delays the man just 
at the point where he knows what he 'vants to do or sav ani is 
ready, but finds the machine not ready. The conclusion is that 
these delays =i r e least tolerable of a 1 1- - m ^c h a n i ca 1 d e 1 ri y s that 
int errupt the loqica 1 process. 

(2) AftSS 1 S£E^i£!i lllSSdUl!- ^ service nessa'je is 
one that asks a procedural or a i mir i s tra t i ve question, r.ot ^ 
substantive one concerned with the ^'i^ta base. It miqht a ^,v , 
"What subject do you want to considfr npxt?" We usp the t ^rm 
§211X122 II1122ti2Il '^V analogy with th^ term SSIvice traffic in 
com mun ica tion 1, referring to messages al^on t thp opera t ion of the 
com municat ions notwork over which sent. Thesp questions h^ve 
little intellectual content and require litt]p thought hv th'^ 
respon ler. H'* would not like to he dplavol by such a message or 
by thp procpss of having that messiqe ac*-el upon. 

(1) ^f^er a 5ilbilliIIi.iX2 I12522II52- When "^ 
substantivp question has been asked and the answer given, a unit 
of work has been performed. The resnorder now knows the subject 
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inat-^<^r will c'lanqc, at iPist '^linhtlv, an1 h<^ is pr^par<=^^ to 

arr*^r)t- a smill delay. It may b*^ n^^cGrsary bpcause it in lik'ily 

t^'^t sofTiP latx has to b*^ stor^rl at. t>ii^ point, and thp program 
m^v i:rino:^(^ a iplay to lo so, 

('^) Alt-E 1 5il0£!l G.il2LX* -Vher the r*^spondor asks 

th'^ cofTinutf^r i ouf^stion, which ho fpols i:s a simple? one, (.such as 
//Tj T7T n ^ or '*r^*tr ieve TFl^J 1, 2, "*") h^ pxp^^cts quick r'^sponsp , delay 
po ^>si>ily in terms of seconds, hut not -ninutos, ThesH are short, 
pr^fM.-.p qur^stions. Me knows what thp answers will looK like ^nd 
no*^-^^^ only th'^ content. 



( ^ ) h.Lt.2L in 2^tflIli2iZ2 ili-Hl- W h p n , on t h -^^ o t h '^ r 
ba:i^, ^ an^-»stion is asked that is o^ an analytic natur^^, such is. 



lit nro-irarns mak^ use o^ file A for input and do not hav^ an 

t o 1 f* r a t e a 
h*^' does not 
m answ •^^, 
vve can a Iso 
r ^Quests for 



'^^rror routine?" the requestor is probably willina to 
Ipnnihv d^-'^lay, even of several minutps. Here, 
ant i r Lr^a^-e M. ^ answer, Pp do-^'s not know if th^r^ is 
H*^ Vnows h^ will have to wait befor*^ ^lo can proceed, 
in:^lule othpr requpsts in this catecorv, such as 
Qon oi:a t ion of a report , 



ove r 



c, User Control of the Int'-^rroaation 

'^he CFI. proq rammer can deleqato a area t l^al of control 
'"in i n t^'^rr oaa t ion to the responder, soiiethinq he will be ir.or^ 
inc 1 i n*=*d to do if he knows he is workinc with ex per ie need people, 
All t h*^ usor control techn iau^s have be'^n described elso wher*^ , 
but w»^ s^all briefly review them here. 

(1) !l£[litlllll* Once a rernonler establishes a fil^ 
on his ti.ijor tonic (proqram or data f^ilp) hp can operate entir^^ly 
in an up^'afinT Tiode thereaftf^r* This rreans ]\^^ speci^ips what 
tou Lcs h^ w i 3hf^s to b^ be in ter rotated u pori and he r«^st ri cts th ^ 
convprsation to these items only, 

( ?. ) Vhf^ QUA-I-ili: L£5J22Zi;2f!- ^ ^' ^^-"^ ^' i "' **" i u r 1 n q ^ 
proqrin loqic description, tlio responder can cl.anap th^-^ nop he Ls 
ler>cri bin i by answer in q //CIIA \' (i^ ♦'o ^n v quest ion. :'e th<Mi 

pro vi les t hp name of the FIOP he wants to .switch to. In this w i y , 
ho i;- fr^^p to document OOP's in any soinonce ^hat is Tieminq^ul 
to h i IP , unconstrained by what thp C^T. nroqramnpr may have thouqht 
bps t . "^he r.T.L oroqrammpr ma v , h ow^vor , d isall ow this respons*^. 

(1) The ^0 ;^0 E'l^^Hon^Z* This response has th*^ 

sam p p^ f <^ct as if it were a pro a ram st at'^m^i: t , Tt causes a 

transfer to the named question in the in f^rroqa t ion proqran, but 
is available 'nainlv for d^^huqqinq ourpos^s, 

(U) The BACK rospons^* ""'h is is anoth<^r v ^ y t}'(> 
r'*";non der ca n t r ansf er to a d i f f erent qu "'s t ion , in this case to 
any qupstion of the last n pi^'^viousl y ask.el. 
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C^) Ill£ 2iI5EI lUli MZQUI E25E2I1525* The.sp finable 
a rosoontier to interrupt the intprroqatlon to ask for information 
from thp rlata base. Data will be returned at the terninal in 
resnonse to a QiiEP Y or at the line printer in response to a 

PFPOP'^, 
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Specifically, 
system are: 



the objectives of the ESDP instructional 



a. To enable the transformation of ESDP-acquired 
documentation into effective instructional text, both rapidly and 
eas ily. 

h. To enable instructors (authors of instructional 
text) to prepare original traininq material not copied from 
exist inq t*^xt, rapidly and easily, when either the requisite 
documentation does not exist, or, in the opinion of th^ 
instructor, it is not of instructional quality, 

c- To enable instructors to prepare either computP'r 
assisted instruction or proqrammed instruction courses (i-o. , 
instruction presented in printed form, off-line) at their option- 
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previously covered material. Thus, if he had forgotten the 
definition of a data item previously explained, he could, before 
answering the current question^ ask for a review of the item 
definition. The student was able to select his own path through 
the instructional material on the basis of ma jor subdivisions. 
If there were several major subjects, he could select the order 
of considering them, but within a major subject he had to follow 
the prescr ibed order of presenta tion of minor topics. 
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An instruction generator that can test these concents 
has been designed and a preliminary model made operational. The 
assumptions underlying this design are the following: 

a. Tn most cases ESDP documenta tion will exist before 
the instruction course is written or compiled and most of this 
documentation will be used as text material in the course. 

b. The courses will be assembled by people familiar 
with the object program system, programming in general, and 
ins tr actional technique. It is not expected that each ob ject 
system programmer will compile his own training materials. While 
much mechanical assistance will be provided to the instructors, 
there will be no diminution of the reguirement for instr action a 1 
skill on their parts, 

c. The object system programs that form the basis of 
the instruction can be expected to change; therefore, the problem 
of keeping the course up to date will always be present, 

2- An Instruct ipn Generating £r2£IE§.i!l- Tmo models of an 
instruction aenerator have been designed and the first of these 
has been made operational. The purpose of the first moiel 
program was to test the feasibility of the approach and to serve 
as a test veh icle for future experiments. 
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a. The Initial Model 

The program has the following features and limitations: 

(1) The generator is an interrogation program 
written in the CAT NT Executive Language, The object program 
(resultant instructional program) is in the same language. The 
object proqram is generated through an interactive process in 
which t he conversation between the generator and instructor is in 
near natural language* Little programming skill is reguired of 
him, but the facility is available for those who are skilled to 
enter PL/I statements of their own into the generated instruction 
program. 




(3) Only multiple choice guestions can he used 
(in Model 1), A guest ion is identified as being true/false, 
yes/no or other multiple choice^ and the student is then 
restricted to answering true or false, yes or no, or a, b, c, d, 
• ••, 2^ A^y answer other than one of these anticipa ted answers 
is unrecogn izable, 

(U) An instructor may insert PL/I language 
sta tements to analyze or process responses, but he is able to 
compile a fully operable and meaningful course without recourse 
to any programming whatever. The generator assists in computing 
a student's grade, and counting unrecognizable answers* It can 
be made to store responses and type out special messages, all 
reguirinq of the instructor only that he specify what is to he 
done, not how. 

(5) The course checks for unrecognizable answers 
and offers the student three chances to change an unrecoinizable 
reply to a recognizable one. If, after three tries, an answer is 
still unrecognizable, the course cuts the student off the 
coTii puter. The course also keeps track of student progress and 
allows him to log on and off, resuming where he left off. 

b. The Second Model 

A second model of the program would expand on the basic 
system, primarily enlarging the number of possible answer types 
and corresponding response analyses* It would provide the 
following features beyond those offered in the first model. 

(1) In addition to multiple choice, instructors 
cou Id allow for: 
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o item responses (one or more 
distinct fields of information in 
the reply) 

o phrase response (short , natural 
language replies) 

o text responses (long natural lan- 
guage replies) 

o lists of item responses. 

Each question may be of a different type, 

(2) Key word extraction routines will be 
available for call by the instructor in conjunction with phrase 
or text responses. These enable him to make some checks on 
extent of subject coverage in a response, (e.g., did the student 
men tion "end of f ile, ") but stilly of course , does not judge the 
adequacy of the content of the reply. 
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(U) The capability to back up, or retrace a path 
will be provided when the author replies BACK to a question, 

(5) With Model 1 there are several subroutines 
available for author use. These, for example, enable him to 
program transmission of a message to a student by entering oaly 
message text as a parameter. The later model will enable thp 
course author to "write" his own subroutines which may then be 
called anywhere in his program. For example, he may wish to use 
a text analysis routine of his own design. He can indicate to 
the Generator that he wishes to compose a subroutine, name it , 
compose it, then assume it is available for his use whenever 
con venient, 

(6) Model 2 will have a full capability to hanile 
program changes after the course has been generated or partially 
gen era ted. This will be done by having the author specify the 
operation (add, change, delete) and identify the location within 
the course. He then resumes the course-gene rating interroqation 
to supply new coding. 
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Handling Changes in Documentation 
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keep the complete instructional system reasonably up to date. 

Both instructors and students must be aware that an 
instructional system is different from an information retrieval 
system; they are not interchangeable with each other • 
Instruction concentrates on manner of presentation and attempts 
to ensure that its users qain a good general understanding. 
Retrieval has the mission to provide up to date information^ and 
may presume that its user can manipulate the system and interpret 
its output with skill. 

Another approach to automatic updating of inst ruction a 1 
material is to hold the programmer who writes the documentation, 
or changes it , responsible for updating the instruction. While 
this approach would work well mechanically, it requires only a 
few more questions to be asked of the programmer as he makes his 
documentation changes, we do not feel that programmers in general 
are necessarily qualified instructors. Skill in writing and in 
ins truction is required, 

d. Production of Programmed Instruction Courses 

The current experiment in producing instructional text 
is not concerned with programmed instruction (PI)^ but an example 
is offered below to show that the ability to produce CAI courses 
by computer can easily yield PI courses as well, 

A typical question, or unit of instruction, generated 
by the ESDP instruction generator, would have approximately the 
form shown in Figure U, 

This is an abbre via ted version of the coding for a 
guestion, but shows most of the essential elements. The same 
question and branching decisions could be used in a PI format, 
which might be as shown in Figure 5, 
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IN5(1): *inSG = 'IS THE PERSONNEL FILE SEQUENCED BY NAME?' 

CALL ASK; 

IF RES = 'YES' THEN DO; GRADE (1) = 1; 

MSG = 'GOOD'; CALL TELL; BRL = 2; 
GO TO INS (1) ; END 

IF RES = 'NO' THEN DO; GRADE (1) = -1; 

MSG = 'WRONG, TRY AGAIN'; CALL TELL: 
GO TO INS (1) ; END 

* The ASK/TELL series of subroutines assumes 

the text of the message to be displayed is 

in data item MSG. If a response is called 

for (it will be in the ASK subroutine if 

used) the response will be in RES. 

Figure 4, A Question in CAI Form, 



INS (1) Is the Personnel File seguenced by NAME? 

If your answer is YES, go to INS (2) 

If your answer is NO, go to INS (1) 

TN3 (2) Good , the correct answer is YES. 
Now, the next guestion • • . 

INS (3) Wrong. To review, we said earlier 
(text of earlier lEN) 

Now go on to INS (2) 
Figure 5, A Question in PI Form- 
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IV 



INSTRUCTIONAL PROGRAMS 
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We define the basic unit of an instruction program to 
be a £1125 tion or unit of instruction. The term anestion is 
slightly ambiguous , but is handier to use. Within the question 
(used here as a synonym for unit of instruction) there can be a 
question (used here as an interrogatory sentence). The unit of 
instruction consists of the elements listed below, some of which 
may be omitted. This is a slightly more rigid organization than 
specified for CEL programs in general, in Section I . 



a. 



Heading 



This is a call to a subroutine provided by the 
generator. Generally, the instructor does not control the 
heading. The subroutine called handles certain internal 
"housekeeping" details needed by the instructional program. 

b. Title 

At the option of the instructor, the UOI or question 
may have a title, which may be the title of the UDP being 
described or any other title provided by the instructor. 



c- 



Text 



Again at the option of the instructor, there may he a 
text portion which would normally be used to present the 
documentation text provided by the programmer when he documented 
his program. Alternatively, the text can be provided by the 
instructor. The text part of a question is displayed to the 
student but does not elicit a response from him. 
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rl • Question 



the text he 
break betw 
draw this i 
text suppl 
question wi 
were compo 
distinction 
as well, 
use is opti 
displayed 
without con 



his part of the UOI asks the student something about 
has just read* Normally, there need be no sharp 
een text and question in programmed instruction^ We 
istinction because often the text will be a copy of 
ied by someone other than th'^ instructor ^ while the 
11 be supplied by the instructor* Tf the instructor 
sing his own text and questions^ he need not make the 
, and could treat the question as containing the text 
A guestion elicits a response from the student* Its 
onal* If not used^ only the title and text are 
to the student and the course proceeds as programmed, 
sidering any response. 



e* Response Analysis 

This portion of the UOI tests the student • s response 
for compliance with predicted responses or functions of responses 
or on other data items, stores the student response and decides 
where in the course to branch next* 

f* Ending 

The ending is analogous to the heading in that much of 
it is suppl ied aut omat ically by the generator program and is used 
for program housekeeping activities. It may also contain 
processing st^ps to be performed regardless of what response the 
student qave to the question, and hence is separated from the 
response analysis section* For exam pie, a branching decision 
could be made on the basis of previous response patterns or total 
SCO re - 

2. An Example'. Figure 6 shows an example of the coding of a 
question in the object instructional program. Labels shown on 
cod ing are labels that might actually appear in the PL/I cod in q* 
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INS (1) : CALL INIT; 



2 
3 

4 
5 
6 
7 
R 
9 
10 

11 
12 
13 
14 
15 
Ifi 

17 
18 
19 
20 
21 

22 
23 

2U 
25 
26 

27 

2R 



XT(1) : 
XQ(1) : 

XA (1) : 



MSG = 'INPUT' ; 
CALL TELL; 

CALL RETRV (lEN) ; 

CALL TELL; 

MSG = 'WHICH OF THESE FILES IS UPDATED DAILY? 

A PERSONNEL 
B PAYROLL 
C NEITHER OF THESE' ; 

CALL ASK; 

IF RES = 'A' THEN DO; GRADE (1) = 1; 

MSG = 'GOOD' ; 
CALL TELL; 
BRL = 2; 
GO TO XE (1) ; 
END; 



IF RES = 'B' THEN DO; GRADE(l) = -1; 

B(l) = B(l) + 1; 
MSG = 'CAREFUL,, 
GO TO XA (1) ; 
END; 



TRY AGAIN' ; 



XE(1) 



IF RES = 'C THEN DO; GRADE (1) = -1; 

MSG = 'READ THE TEXT AGAIN, 

CAREFULLY' ; 
CALL TELL; 
GO TO XT (1) ; 
END; 

CALL UNRECOG; 
CALL NEXT; 



Figure 6. A Unit of Instruction or Question, 
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Figure 6. 



The following comments are keyeti to linp numbers in 



The label of the question is automatic ally 
com posed, and fits the reqairements of a label in 
a PL/ I label array. A CALL is inserted to the 
standard bookkeeping routine. 



2,3 The title ''INPUT" is displayed. This title was 
composed by the instructor, or course a uthor ; 
otherwise , a retr ieval call would be here that 
would retrieve the title from a list in memory. 
The subroutine TELL does not call for a response. 



f^-9 
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Here the question is being posed. 
been supplied by the instructor, 
multiple choice question. 

The label denotes the beginning of the response 
acquisition and analysis section. The ASK 
subroutine elicits a response from the student ind 
places that response in da ta item RES. 



11 The first response checked for is A; this being 
automatic if a multiple choice question form has 
been selected. If this answer has been qiven, a 
grade for the question is assigned. The value of 
the grade is determined by asking the instructor 
during the gene ration of the course whether the 
answer is correct or not. If correct, the student 
gets +1, if not, -1. It is not necessary that 
each question be identified as either right or 
wronq. 



12, 13 The instructor has chosen 
student with the comment "GOOD. " 



to " reward'^ the 



lu The instructor has stated that he wants to ao next 

to question 2, which is at label INS (2) . 
Branching out of the question is done only at the 

end of the question. Here, the value of 3RL 

(branch label) wh ich will be used to index a label 
variable is set to 2. 

15 Transfer is now made to the ending routine for tho 
question, XE (1) . 
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17 " B" is a wrong answer, hence the grade is set to 
-1. 

18 The instructor wants to know how often this answer 
was given, so he introduces his own counting 
variable, B (1) . 

19,20 The student is told to answer the question 
again, and is branched to the beginning of the 
response analysis area. The question will not be 
repeated, but the branch is to a CALL ASK 
statement. 

2S Here, in the analysis of the third recogn izable 
answer, the instructor feels the student must have 
grossly misunderstood the text to have given this 
answer, so he is going to force a review by 
repeating the text by a branch to the beginning of 
the text presentation area, XT (1) . 

27 If no recognizable answer is given, a call is m\de 
to subroutine UNRECOG which will converse with the 
student, try to get a recognizable answer from him 
and, if it cannot, cut the student off. 

28 The label XE(1) denotes the ending of the UOT. 
The subroutine NEXT performs the actual branching 
to the next question. 

3. Com£Osition of a Question. More specifically, the functions 
and options available for each component of a question are: 

a. Heading 

All questions must have a heading, hence the heading is 
not under control of the instructor. Included are the label for 
the question (the label of the PL/ 1 code group associated wit h 
the question) . All such labels are part of a PL/ I label array 
and consist of an alphabetic prefix, INS, followed by a subscript 
generated by the generator program. Next , the documentation to 
which the question pertains is ascertained. This is elicited 
from the instructor, as the composition of each question starts, 
by the computer asking him what lEN his question is associated 
with. Finally, the heading concludes with a call to the 
INIT(ializing) subroutine which records, for the object program, 
which label is being executed and resets various counters and 
registers. 

b. Title 

The title is entirely under control of the instructor 
and is optional. Upon being asked for a title, the instructor 
may respond : 
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IEN=n 

//NO 

(title) 

The first of these responses directs the genera tor to place in 
the object program the coding needed to retrieve the title that 
corresponds to the lEN he has selected. This will be the title 
used with the ESDP standard report form* For example, he may 
insert TEN=1.2 where 1.2 is the INPUT DATA DESCRIPTION in the 
standard report. In that case, the object program wi 11 con tain a 
call to a subroutine that retrieves the stated title at ohj-act 
time. If no title is to be used, the instructor replies //NO. 
If, when the instructor is asked for a title, he gives any other 
response, that response is used in the ob ject program. He miaht, 
in the earlier example, have used INPUT, preferring the shorter 
version of the standard title. In this case, the actual text is 
com piled into the object program. 

c. Text 

Essentially the same options are available to the 
ins tructor when text is called for by the genera tor program. In 
this case, if he replies IEN = n, the progra mraer- supplied text 
associated with n is implicated , not the title of n . Aga in , a 
call to a subroutine that will retrieve the text at object time 
is inserted into the object prografu, rather than the actual text. 

d . Question 

Questions will not have been stored by programmers 
before the instruction course is composed, so the instructor will 
always com pose his own guest ion, if he wants to use one. He in ay 
respond, then, with the text of the guestion or with //NO which 
means no question is to be asked. 

o. Response Analysis 

This is the most complex of the guestion components. 
First, the generator ascertains what form of question is to be 
used: multiple choice, etc. Then, a different set of 
interrogations may follow depend ing on what form of guestion is 
used. As an exam pie, assume a true/false form is to be used. 
Then the generator automatically starts the response analysis 
component with the strinq: 

IF RES = 'T' THEN DO; 

where RES is the data item which contains the student's answer to 
the guestion. 

For each test of an anticipated answer (such as "" for 
TRUE) there is an associated THEN DO,,, END clause and an optional 
ELSE DO. . . END clause. The combined clauses are referred to as an 
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answer set: the set of code concerned with analyzing one 
anticipated answer. There is an answer set for each anticipated 
answer and one for unrecognizable answers. 

The instructor is asked if TRUE is a correct answer to 
the question. If so^ the next string genera ted is 

GRADE(LABEL) = 1 

where GRADE is an array of one-character^ decimal iteras and LABEL 
is the subscript on the label array. If the answer were deemed 
incorrect, GRADE would be set to -1. 

When the author selects a u It i pie choice as a question 
form, the array of possible answers is elicited from him, to 
assist him in compiling the question. As soon as he selects the 
multiple choice mode, he is shown a display similar to 

A.ENTER VALUE 

The author then enters the first of the answers he wants his 
stu dent to consider. The process is cumulative. As soon as the 
author gives a reply, that reply is displayed and a new line is 
created ask in g for the next possible a nswer. The sequence is 
terminated by //END and might ta ke this form: 

A. ENTER VALUE _ABRAHAM LINCOLN 

A. ABRAHAM LINCOLN 

B. ENTER VALUE _GEORGE WASHINGTON 

A. ABRAHAM LINCOLN 

B. GEORGE WASHINGTON 

C. ENTER VALUE _//END 

Now the instructor is asked about any addit iona I 
processing he may want done by the object program at the point 
where the student has responded with a TRUE. His options are: 

Execute an assignment statement 

Type out a message 

Count (i.e., add 1 to a designated data item) 

Sum (i.e., add RES to some designated data item) 

Store (i.e. , store the contents of RES in a 
standard location, indexed by LABEL) 

The count and sum options are intended for arithmetic 
processes other than keeping track of the student's grade. Using 
them does not require that the instructor enter a full PL /I 
statement, only that he designate which item is to bo 
inc remented. 
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similarly, indication that a message is to be typed out 
requires only that the instructor enter the message^ not that ho 
enter a PL/I statement that would type out the message. 

The only option that requires the instructor to enter 
actual programming statements is the assign option. This was 
included for those cases not covered by the more simple 
operations just described. If the assign option is used, the 
ins true tor enters a PL/I statement which is chocked for validity 
by the generator. He must assume the responsibility for its 
correct a p plica tion, but the generator assures him that only 
legal PL/I commands are put into the object program. While this 
feature has many uses, it should be apparent that fairly 
ela borate instructional programs can be composed without using 
it. The statement validity-checking subroutine is not yet 
implementei , At present, any character string entered in 
response to the question is accepted and assumed to be a PL/I 
sta temen t. 

The final step in each clause of an answer sot is to 
find where the instructor wants to branch if the student has 
given the answer used in the test . (One restriction being 
imposed on the initial version of this program is that there may 
not be ^n IF following a THEN or ELSE, Another is that, in a 
multiple choice question, no information other than the response 
[Tiay be used to decide on branching- The capability to use other 
infomation will be inserted later, when iteiti and text responses 
are perniittel, for the logic involved follows immGdiately from 
the logic o^ orocessing those replies,) The instructor may select 
the question to which to branch by specifying any of: 

Back to a previous label (the label 
given must be on a list of 
generated labels) 

Forward to a new label (the label 
given may not have been generated 
yet) 

Forward to the next sequential 

question (with this choice it is 

not necessary to give the actual 
label) 

Then there are several options for branching to other 
points within the current guestion. These are: 

Back to the text, so the student 
gets the entire tutorial section 
over again 

Back to the guestion, so the 
guestion is repea ted but not the 
tutorial text 
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Back to response analysis, so a new 

answer is elicited and all analysis 

performed on it, but none of the 

foregoing text or question material 
is repeated 

When branching to a different question, entry can only 
he made at the "top" of that question. The author cannot skip 
the heading. 

Lists are maintained of all generated labels and all 
future labels (those indicated as forward branch labels at a 
branch point) • Whenever the instructor goes on to a new 
question, hp will be given a list showing from where else he 
branched to the same label. If he finds he has made a mistake 
and did not intend to go to the same label from two different 
points, he may change his most recent decision. 

Branching is not actually done from the IF statement to 
the designated label. The IF statement will contain an 
assignment statement that stores the label to which bra nching 
outside the boundary of the UOI is to be done , then actual 
branching is to the ending component of the question. 

As many IF statements, or answer sets, are generated as 
the re are possible answers to check. Up to ten are allowed in a 
multiple choice. When full constructed item response analysis is 
implemented , there will be no limit except that imposed by memory 
considerations. 
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ANSWER UNRECOGNIZABLE 

YOU MUST ANSWER TRUE OR FALSE 

The first of these is inserted into the object course 
automatically by the generator, the second is provided by the 
instructor. If the student cannot give a recognizable answer in 
three tries, he is assumed to have grossly misunderstood the 
instructions or to be playing games, a common, apparently 
irrestible, urge among CAI students. The instructor may com pose 
his own unrecognizable answer routine. 
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f. Ending 

The ending routine gives the instructor the opportunity 
to do processing that applies to all answers ^ whether or not they 
match any of the anticipated answers, resets various counters, 
and performs the actual branch to the selected next question. 
The reason for doing the branching in this way is to enable the 
question to be operated as a subroutine, if necessary, or to be 
part of a sequential program, depending upon the value of some 
stated item. That is, if the student is in a review mode, he nay 
be routed to a given question, then back to the review control 
question , regardless of this answer. In CAINT courses, we use 
this technique a Iso for interrogating a programmer only on 
selected questions when he is updating files. 

4. Composition of the P rog ram. An object instructional program 
consists of up to 999 questions of the form just described (the 
number 999 being completely arbitrary, but some limit is 
necessary) . When all the questions have been compiled, the 
generator program must generate introductory and terminal 
material for the object course. 

Introductory material consists of required labels and 
statements of PL/I^ such as data decla rations. These are 
generated from lists of data items genera ted in the main body of 
the course. The terminal part of the course consists of a 
standa rd grade-compu ting routine , one that gives not only a count 
of right and wrong answers, but also a list of the number of 
unrecognizable a nswers at each question, and could be extended to 
give grades wit hi n major sections of the course. The terminal 
sec tion also contains subroutines, completely pre- writ ten, that 
must be a part of any object program. 

The f inal result of operation of the generator proqram 
is a compl ete, syntactically valid PL /I proqram, together with 
all subroutines and specification statements. There can be no 
qua ran tee that the course will execute successfully, because the 
instructor nay have inserted invalid or meaningless statements, 
but the course should always compile. 

^- H^ina LhS. ^ZStSSl* '^h^ Instruction Generator is a new concept 
which offers a significant improvement in the potential for usino 
CAI and PI for on-the-job training. Certainly, more time is 
needed to complete the generator and to test it, both as a 
program to bo debugged and as an educational tool. 
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